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Histogram Monte- Carlo simulation results are presented 
for the magnetic-field - temperature phase diagram of the XY 
model on a stacked triangular lattice with antiferromagnetic 
intraplane and ferromagnetic interplane interactions. Finite- 
size scaling results at the various transition boundaries are 
consistent with expectations based on symmetry arguments. 
Although a molecular-field treatment of the Hamiltonian fails 
to reproduce the correct structure for the phase diagram, it 
is demonstrated that a phenomenological Landau-type free- 
energy model contains all the esstential features. These re- 
sults serve to complement and extend our earlier work [Phys. 
Rev. B 48, 3840 (1993)]. 
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I. INTRODUCTION 

Although finite-size scaling studies of critical phenom- 
ena based on Monte-Carlo histogram (MCH) datafl for 
unfrustrated systems has proven highly effective in the es- 
timation of critical exponents^ and in the determination 
of weakly first-order transitions," corresponding stud- 
ies of possibly more interesting frustrated lattices have 
proven more demanding.cTEl The utility of this approach 
in examining the critical properties of the variety of phase 
transitions which occur under the influence of an applied 
magnetic field in the ferromagnetically stacked triangular 
XY antiferromagnet is demonstrated here. The Hamil- 
tonian is written as 



<ij> 



<kl> 



where the spins lie in the basal plane, Jy < is the fer- 
romagnetic interplane interaction, J±_ > indicates the 
antiferromagnetic coupling which is frustrated for the tri- 
angular geometry < i,j > and < k,l > represent near- 
neighbor sums along the hexagonal c axis and in the basal 
plane, respectively and the field is applied in the basal- 
plane direction x. The general structure of the phase 
diagram shown in Fig. 1 was determined in our earlier 
workLl (hereafter referred to as I). Phases are labelled by 
the nonzero components of the (complex) spin polariza- 
tion vector S = S a + iS&. The Neel transition at zero 
field is to the well-known helically polarized 120° spin 
structure {S ax — Shy). Indicated on the figure are the 
elliptically polarized phase 7, linear phases 6 and 9, as 



well as the paramagnetic state 1. Phase 6 is of particu- 
lar interest as it has the symmetry of the 3-state Potts 
model and should exhibit a weak first-order transition to 
the paramagnetic state. This was confirmed by extensive 
finite-size scaling of the extrema in various thermody- 
namic functions which occur at the 1 — 6 phase boundary 
for magnetic field strengths H = 0.7 and H — 1.5. Data 
for H = 0.7 can be found in I. In addition to presenting 
the corresponding MCH data at H — 1.5, finite-size scal- 
ing results are given here for the other three transition 
lines, at the points indicated on Fig. 1. „ 

It is of interest to note that Lee et alB examined the 
XY antiferromagnet on a triangular lattice (un-stacked) 
in an applied magnetic field. At H=0, the transition 
shows Kosterlitz-Thouless (KT) behavior but the field 
breaks rotational symmetry and transitions involving 
true long-range spin order can occur. The resulting phase 
diagram in this 2D case is very similar to that of Fig. 
1. Using traditional finite-size scaling of their MC data, 
these authors reported that the 1 — 6 transition belongs to 
the 2D 3-state Potts universality class, but that the other 
transition lines exhibited nonuniversal critical behavior; 
different exponents were found for different points on a 
transition line. We find this latter conclusion is some- 
what surprising but may be due to KT-like excitations 
in some cases. The possibility always exists that the MC 
data were not sufficiently accurate to distinguish among 
the variety of possibilities. 

Before discussing our own MCH data for the 3D model, 
it is useful to examine the results of a mean-field analysis 
based on the Landau theory of phase transitions. 



II. MEAN-FIELD THEORY 

Mean-field analyses of magnetic phase diagrams based 
on Landau-type free energies for frustrated spin systems 
have proven to be quite successful in reproducing the es-i 
sential features of both MC and experimental results. El 
(A noteable exception is the XY model on a stacked tri- 
angular lattice, with both Jii , J± > 0, in the quasi-2D 
caseEl where Jii << Jj_). It was previously demon- 
strated for the 2D version of the present model that a 
molecular-field treatment of the Hamiltpoian (1) yields 
a phase diagram with phase 6 absent .til Identical re- 
sults are expected for the 3D model under considera- 
tion here. It is shown below, however, that the phe- 
nomenological Landau approach can capture all of the 
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essential features of the phase diagram of Fig. 1. Such 
a treatment is also useful in understanding analytically 
the interactions which are responsible for stabilizing each 
phase. In addition, an examination of such a free energy 
(which has the same structure as an appropriate Landau- 
Ginzburg- Wilson Hamiltonian), together with symmetry 
arguments, is useful in determining expectations regard- 
ing the critical behavior of the various transition lines. 

Following the method outlined in Ref. [l^ , the free 
energy is expanded to fourth order in the spin density 

s(r) = m + Se jQr + S*e" iQ - r (2) 

where m is the uniform component induced by the mag- 
netic field and Q is the wave vector. The result can be 
written as 

F = A Q S 2 + ±A' Q m 2 

+ \B z m A + 2B 4 | m • S | 2 
+ S 6 [(m-S)(S-S) 

+ m H, (3) 

where A Q = a{T - T Q ) and A' = a{T - Tq). This ex- 
pression is identical to that used in our analysis of the 
magnetic phase diapam for the case of antifcrromagnetic 
interplane couplingEj except for the additional term B§. 
As emphasized in I, this term cubic in S occurs since 
the ordering wave vector satisfies the relation 3Q = G, 
where G is a reciprocal lattice vector. The cubic term is 
responsible for the stability of the 3-state Potts phase 6. 
It is important to note that from symmetry arguments 
alone, each of the fourth order coefficients Bi in (3) is 
independent since each corresponding term is an inde- 
pendent invariant with respect to the relevant symmetry 
operations. 

A free energy identical in structure to (3) may also be 
derived fnp a molecular-field treatment of the Hamilto- 
nian (1)H In this case, all the fourth-order coefficients 
are the same and given by Bi = bT, where for classical 
spins b = |. Since the Landau expansion is applica- 
ble only in regions where S is small, the approximation 
Bi ~ 6Tjy is usually made. In addition, the molecular- 
field treatment yields a = 3, as well as 

T Q = 2(- J,, + 3J±)/a, Tq = - 2( J„ + 3 J ± )/a. (4) 

Thus, the exchange constants are the only parameters 
which appear in this theory. 

Fig. 2a shows the resulting phase diagram from an 
analysis of the free energy from molecular-field theory 
expanded to sixth order in s using J|| = —1, Jj_ = 1 
and H|jx. It is seen to have the same structure as the 
mean-field result in Ref. |ll|. The 3-state Potts phase 6 
does not appear. An analysis of the free energy reveals 
that this state is somewhat accidentally excluded. This 
conclusion is demonstrated by results from the more gen- 
eral phenomcnological model. Analysis was made using 
the same parameter-values as in the molecular-field the- 
ory, except that one of the fourth-order coefficients Bi 



was made to be different from bT. Results for the cases 
B4 = 1 and 0.1 are shown in Figs. 2b and 2c, respec- 
tively. Phase 6 now appears. The correct structure of 
Fig. 1 is reproduced by the smaller value of B^. Simi- 
lar results occur if only B^ or Bj, are set to be different 
from the other Bi. It seems that some effects of critical 
fluctuations not accounted for within mean-field theory 
can be mimicked by the more general phenomenological 
model in this case. 

The stability of each state in the phase diagram can 
be understood by examining the terms in (3) with the 
assumption Bi > 0. At zero applied field (m — 0), the 
i?2-term is minimized with S • S — 0. This is achieved 
by a helical polarization S ax — Sb y ■ At low temperatures 
and low values of the applied field, the i^-term, which 
favors a configuration S_Lm, distorts the helix into an 
ellipse (phase 7), S ax ^ Sby At higher temperatures and 
low field values, the B^-term dominates and favors phase 
6 with a configuration S||m. The high-field phase 9 is a 
result of both B^ and i?6-type interactions which favor a 
linear polarization. 

This analysis allows some predictions to be made re- 
garding the nature of the phase transition lines of Fig. 
I . The 1 — 6 line should be first order due to the rele- 
vance of the cubic term Bq, as confirmed in I. (We note, 
however, that mean-field theory would also suggest the 
same behavior in 2D. In fact, this transition belongs to 
the 2D 3-state Potts universality class.) A continuous 
1 — 9 transition is the result of the mean-field analysis 
despite the nonzero value of the Potts variable S ax . A 
first-order transition does not occur in this case because, 
as discussed in I, the £?6-term effectively disappears at the 
paramagnetic boundary line at some power of S greater 
than three. It is not clear what the effects of critical fluc- 
tuations will be regarding this scenario. If the transition 
is continuous, it should belong to the XY universality 
class since both S ax and S ay are involved. The remain- 
ing two transition lines, 6 — 7 and 6 — 9 should both belong 
to the Ising universality class as only a single component 
of S is involved in each case. A purpose of the finite-size 
scaling analysis described below is to test these predic- 
tions. 



III. FINITE-SIZE SCALING 

The analysis of MC generated histograms used here 
to determine finite-size scaling behavior is described in 
I. In most cases, scaling was performed on the ex- 
trema of a variety of thermodynamic functions, includ- 
ing the specific heat C, susceptibility x, energy cumu- 
lant U(T) = 1 - \{E A ) / {E 2 ) 2 , and the logarithmic 
derivative of the order parameter M, which is equivalent 
to V(T) = (ME)/(M) - (E). The energy cumulant 
exhibits a minimum near Tjy, which achieves the value 
U* = | in the limit L — > oo for a continuous transition, 
whereas U* < | is expected in the case of a first-order 
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transition. The thermodynamic quantities should display 
volume-dependent scaling, L 3 , in the case of a first-order 
transition (except for M), or scaling as L x , where x is 
a ratio of critical exponents, in the case of a continuous 
transition. Finite-size scaling results for the order param- 
eter, evaluated at the estimated critical temperature, are 
presented only for the 1 — 9 transition. For reasons un- 
known to us, it appeared that the values of L used here 
were to small to obtain reliable results for this quantity 
in the other cases where a continuous transition was ex- 
pected. Partly due to the relatively large fluctuations in, 
the MCH data, a general feature of frustrated systems,Q 
the approach taken in this work is to simply determine if 
the results are consistent with the expectations and pos- 
sibilities outlined above: Scaling was performed with as- 
sumed exponent values. This method of presenting data 
was also used in I, as well as in Refs. [| and %, and is 
useful in cases where the true critical behavior may be 
revealed only at larger lattice sizes. The alternate ap- 
proach of presenting data in the form of Log-Log plots is 
more appropriate in cases where very reliable statistics 
are available and finite-size correction terms to simple L x 
behavior should be negligible. 

Simulations were performed on the Hamiltonian (1) 
with J|| = — 1 and J± = 1 using periodic boundary con- 
ditions on Lx Lx L lattices. In most cases, a random ini- 
tial spin configuraion was used and thermodynamic aver- 
ages were estimated after discarding the first 2 x 10 5 MC 
steps for thermalization. In other cases, the final, well 
thermalized, configuration of a previous run was used for 
the initial spin directions. Further details are given in the 
following sections which describe the results of finite-size 
scaling at each phase-boundary line. 

A. H=1.5: 1-6 Transition 

Results of the histogram analysis at H = 1.5 for the 
1 — 6 phase boundary are also discussed briefly in I. Sim- 
ulations were performed on lattices L — 12 — 33 with 
1 — 2.6 x 10 6 MC steps used for thermal averaging. The 
increased number of MC steps for larger lattices was used 
in an effort to account for an expected increase in the cor- 
relation time. Histograms were made at T = 1.52 and 
T = 1.523 and the critical temperature was estimated to 
be T c — 1.522(2) from the finite-size dependence of the 
various thermodynamic extrema. The results shown in 
Fig. 3 demonstrate that the expected volume dependence 
of a first-order transition may not be evident at smaller 
values of L. This aspect-of MC simulations has only re- 
cently been emphasized BeI The extrapolated value of the 
energy culumant (Fig. 3a) is close to the value expected 
of a continuous transition, ~, indicating that it is only 
weakly first order. This conclusion is corroborated by 
the estimated latent heat given in I. 



B. H=0.7: 6-7 Transition 

The 6 — 7 boundary is expected to be a line of contin- 
uous transitions belonging to the Ising universality class. 
MC histograms were made for L = 12 — 30 at several 
temperatures between T = 1.40 and T = 1.45 using 
1 — 3 x 10 6 steps for averaging. The transition tempera- 
ture was estimated to be T c = 1.425(4). Much difficulty 
was experienced in locating extrema in the thermody- 
namic quantities for L = 12 and these data were not 
used in the finite-size scaling analysis. Several runs us- 
ing the larger lattices exhibited widley varying results, 
indicating that critical fluctuations are significant at this 
transition (possibly due to the proximity of the param- 
agnetic state). For example, it was not possible to obtain 
reliable results for the order parameter. Fig. 4a shows 
a logarithmic plot of the energy cumulant. The extrapo- 
lated value U* = 0.666665(4) suggests that the transition 
is indeed continuous. The slope —2.9(1) is close to —3, 
as expected for ccptinuous transitions if the exponent 
ratio a/v is small,E-3 as in the present case. Finite-size 
scaling of the other thermodynamic quantities shown in 
Fig. 4 was. made with the assumption of Ising critical 
exponentsE As in the case of Fig. 3, these results sug- 
gest that the true critical behavior is revealed only at 
larger lattice sizes (especially the data for V max )- Scal- 
ing with the assumption of volume dependence gave very 
unsatisfactory results. 

C. H=2.7: 6-9 Transition 

The anticipated difficulty in obtaining reliable esti- 
mates for the location of extrema in the thermodynamic 
quantities as a function of temperature at the 6 — 9 tran- 
sition was realized. This was due to the near zero slope of 
this boundary line in the H — T plane so that large fluc- 
tuations between the two phases occurred. (A more suit- 
able, but a more memory- and time-consuming, approach 
would have been to obtain extrom function of mag- 
netic field from the histograms £l) For this reason, finite- 
size scaling was performed at the (crudely) estimated crit- 
ical temperature. Smaller lattice sizes, L = 12 — 27, were 
chosen in order to minimize the effect of an error in the 
estimated T c . 2— 7x 10 6 MC steps were used to create his- 
tograms at a number of temperatures between T — 1.20 
and 1.28. Scaling consistent with the anticipated Ising 
universality, as shown in Fig. 5, was found by assuming 
a critical temperature T c = 1.23(1). Note that the scale 
of Fig. 5a for the specific heat is approximately the same 
as used in Fig. 4b and reflects the very small slope of 
the fitted line. Our MCH results for the order param- 
eter were again found not to be reliable for this tran- 
sition. The extrapolated value of the energy cumulant, 
U* = 0.6666668(8), clearly indicates that the transition 
is continuous. As in the previous case, the slope —2.99(5) 
of Fig. 5b is consistent with a small value for a/ v. 
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D. H=4.0: 1-9 Transition 

Although the 1 — 9 transition is expected to belong 
to the XY universality class within mean-field theory, 
the not unlikely possibility exists that the cubic term 
in the free energy becomes relevant when critical fluc- 
tuations are included. Histogram data were taken at 
T = 1.42 and T = 1.44 on lattice sizes L = 12-33 
with 1 — 3 x 10 6 steps for averaging. Volume-dependent 
scaling was not observed in the extrema of thermody- 
namic functions. Further support for the continuous na- 
ture of this transition comes from the extrapolated value 
U* = 0.6666664(8), where the energy-cumulant scaling 
exponent was found to be —2.8(2). Finite-size scaling 
consistent with XY universality is shown in Fig. 6, in- 
cluding the order parameter evaluated at the estimated 
critical temperature T c = 1.423(4). 

IV. CONCLUSIONS 

This work on the phase diagram of ferromagnetically 
coupled antiferromagnetic XY triangular layers contains 
two results of importance. The first is that although 
molecular-field theory fails, a more general phenomeno- 
logical model is capable of capturing all the essential fea- 
tures. This mean-field model also allows specific predic- 
tions to be made regarding the expected critical behavior. 
Secondly, the histogram Monte Carlo method has been 
demonstrated to be useful in verifying this anticipated 
criticality through finite-size scaling of thermodynamic 
functions. Relatively large fluctuations observed in the 
MC data is attributed to the frustration inherent in the 
triangular geometry. These -results serve to complement 
and extend our earlier work,Q as well as that of Lee et alH 
who studied the corresponding two-dimensional system. 
Although these authors suggest nonuniversal critical be- 
havior on all transition lines, except the 1—6 boundary, in 
the 2D case, our analysis suggests that only the 1—9 tran- 
sition should exhibit XY symmetry and the consequent 
KT-like excitations associated with such nonunivcrsality. 
It is of interest to perform histogram MC simulations on 
the 2D system to examine these issues further. As men- 
tioned in I, a good experimental candidate for the present 
3D model is LC12C01.7E3 
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FIG. 1. Phase diagram from Ref. 6. Indicated are the 
paramagnetic phase 1, linear phases 6 and 9, and the elliptical 
(chiral) phase 7. Solid and broken lines are guides to the eye 
and indicate first and second-order transitions, respectively. 
Solid circles at H=0.7, 1.5, 2.7, and 4.0 denote points at which 
finite-size scaling analyses were performed (where results at 
H=0.7 for the 1 — 6 transition are in Ref. 6). 
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FIG. 2. Mean-field results for the phase diagram, where (a) 
is based on a free energy derived from molecular-field theory, 
(b) is from the phenomenological Landau free energy (3) with 
all parameters as in (a) except B4 = 1, (c) is from the same 
model as (b) but with B4 = 0.1. 

FIG. 3. Finite-size scaling of extrema for the 1—6 transition 
at H = 1.5 near T c ~ 1.522 with the assumption of volume 
dependence, (a) shows the energy cumulant, where values for 
L = 12 and 15 have been omitted to allow for an expanded 
scale. All results for L — 12 — 33 are shown in (b) and (c) for 
the specific heat, susceptibility, and logarithmic derivative of 
the order parameter. 

FIG. 4. Finite-size scaling of extrema for the 6—7 transition 
at H = 0.7 near T c ~ 1.425 with the assumption of Ising 
univerality using data from lattices L — 15 — 30. 

FIG. 5. Finite-size scaling results for the 6 — 9 transition at 
H — 2.7 of thermodynamic functions evaluated at T c ~ 1.23 
with the assumption of Ising univerality using data from lat- 
tices L = 12 - 27. 



FIG. 6. Finite-size scaling of extrema for the 1—9 transition 
at H = 4.0 near T c ~ 1.423 with the assumption of XY 
univerality using data from lattices L = 12 — 33. 
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